Performance Evaluation Program Research Articles

Performance Evaluation of Community Welfare Programs: A Public Policy Analysis Approach

This journal article conducts a rigorous performance evaluation of community welfare programs using a public policy analysis approach. The research employs a systematic framework to assess the effectiveness, efficiency, and equity of existing community welfare initiatives. Drawing on principles of public policy analysis, the study critically examines the implementation processes, outcomes, and impacts of these programs on community well-being.
 The evaluation involves a combination of qualitative and quantitative methods, including surveys, interviews, and statistical analyses. It scrutinizes the alignment of program objectives with societal needs, the adequacy of resource allocation, and the inclusivity of program outcomes. By employing a multidimensional evaluation framework, the research aims to provide a nuanced understanding of the strengths and weaknesses of community welfare programs.
 The findings offer insights into the policy implications of the evaluated programs, highlighting areas of success and opportunities for improvement. The research emphasizes the importance of incorporating community feedback and participation in program design and implementation to enhance overall effectiveness. Additionally, it explores the role of government policies in shaping the landscape of community welfare initiatives, providing a foundation for evidence-based policymaking.
 In conclusion, this article contributes to the field of public policy analysis by offering a comprehensive evaluation of community welfare programs. It advocates for a continuous feedback loop between policymakers, program administrators, and the communities served, fostering a more adaptive and responsive approach to addressing societal needs.

Kebijakan pengembangan dan peningkatan mutu sumber daya manusia kearsipan di Dinas Perpustakaan dan Arsip Daerah Kabupaten Rejang Lebong

The purpose of this study was to analyze the policies for developing and improving the quality of human resources at the regional library and archives service in Rejang Lebong Regency. Data were collected by interview, observation and documentation methods. The results of the study indicate that the archival HR development policy at the Regional Library and Archives Service of Rejang Lebong Regency focuses on the following matters, namely: 1) Management of Inactive Archives:; 2) Static Archive Management:; 3) Archive Depreciation Management; and 4) Archive HR Certification. Whereas for improving the quality of archival human resources at the Regional Library and Archives Service of Rejang Lebong Regency includes technical guidance that refers to national competency standards in the field of archiving. The implementation of education and training activities is a very important effort in improving the capabilities and competence of archival HR. Implementation of certification activities for HR archives, and Efforts to streamline work performance evaluation programs for archival HR

Seek and Ye Shall Find: An Empirical Examination of the Effects of Seeking Real-Time Feedback on Employee Performance Evaluations

This research delves into the impact of real-time feedback applications on the engagement of employees with performance evaluation programs. The study focuses on feedback-seeking behavior and rating, which have been neglected in previous literature. The research analyzes nearly 11,000 feedback instances from employees at four major organizations to examine how seeking and rating feedback affects in-kind evaluations. The results indicate that seeking feedback can enhance constructive communication among colleagues. Feedback seekers receive lower feedback scores but are more likely to receive longer and more subjective comments. Feedback givers who choose to remain anonymous provide shorter comments or no comments to feedback seekers. The study also reveals that feedback seekers prioritize longer comments over high feedback scores when rating feedback. The study recommends that managers and organizations encourage feedback-seeking behavior to promote a culture of constructive feedback. When implementing feedback applications, it is important to prioritize creating an environment that fosters constructive feedback.

ESTUDIO DE CLIMA ORGANIZACIONAL PARA EL DESARROLLO ECONOMICO DE UNA PROCESADORA DE MIEL DE ABEJA EN EL SURESTE DE MEXICO

The purpose of this research is to evaluate the level of openness of the organizational climate of a honey processor established in the southeast of Mexico. This study is quantitative. The results show that the organizational climate of the company is of a semi-open degree. This indicates that there is some openness to improvement. However, there are also some problems such as the lack of management support and concern for the employees. To help workers feel supported and recognized for their performance, it is proposed to create a performance evaluation program, which will allow increasing effort and commitment. In addition, it is suggested that bosses get involved and improve their relationships with staff in order to influence productivity and therefore the economic development of companies.

Estimating the cost efficiency of public service providers in the presence of demand uncertainty

Public service managers generally make input choices in the face of uncertainty about future demands for service. This is generally not taken into account when estimating cost efficiency. In the operations research literature, for example, the standard approach to estimating cost efficiency is based on the assumption that managers choose inputs to minimise the cost of producing realised (i.e., observed) outputs. However, when outputs are unknown at the time input decisions are made, most managers will instead choose inputs to minimise the cost of producing output targets (e.g., minimum service levels, predicted maximum demands). In this paper, we explain how data envelopment analysis (DEA) estimators can be used to estimate cost, technical and allocative efficiency in these situations. The methodology is applied to Australian data on hospital and health service providers. We obtain estimates of efficiency that are quite different from estimates obtained using a standard approach that ignores uncertainty. Our work has important implications for performance evaluation and improvement programs in many public service settings.

Principal Professionalism in Improving the Quality of Education in Senior High School

This research aims to analyze and describe the professionalism of school principals in improving the quality of education based on the Regulation of the Minister of Education and Culture of the Republic of Indonesia Number 40 of 2021. The research method is a qualitative case study approach. Data collection techniques with interviews, observation, and documentation. Data processing techniques with reduction, data presentation, and concluding. Data validity technique with source and technique triangulation. Based on the research conducted, the following research results were obtained: aspects of learning development, the principal of Hang Tuah 1 Senior High School Surabaya conducts an annual performance evaluation and competency improvement program for teachers and education staff. In terms of school culture, the principal of Hang Tuah 1 Senior High School Surabaya develops a vision and mission, creates a safe, disciplined school environment, works according to duties, and collaborates. In terms of improving the quality of learning processes and outcomes, the principal of Hang Tuah 1 Senior High School Surabaya conducts coaching, training, supervision, file examination, and evaluation of school programs. In terms of entrepreneurship development, the principal of Hang Tuah 1 Senior High School Surabaya opened a hotel school. In terms of assessing the performance of teachers and education staff, the principal of Hang Tuah 1 Senior High School Surabaya formed a performance appraisal team. In the aspect of teacher guidance and coaching, the principal of Hang Tuah 1 Senior High School Surabaya provided mentoring and teacher competency training.

Performance Evaluation of DualSPHysics and COMCOT Programs through Numerical Testing for Simulating Tsunami Propagation and Overtopping on Seawalls

A tsunami is a destructive wave that can cause massive damage to coastal infrastructure. One of the disaster mitigation measures that can be chosen is the construction of coastal protection infrastructure, such as a seawall. Seawalls play a crucial role in protecting coastal areas as they can reduce wave energy and minimize the impact of tsunami-induced damage. However, during the 2011 Japan tsunami, the seawall built in Taro city failed as it proved to be less effective in handling the tsunami waves. The research conducted aims to model the propagation and overtopping of tsunami waves on the seawall, initially carried out through physical laboratory experiments, and later transformed into numerical test models using the Smoothed Particle Hydrodynamics (SPH) method and the Cornell Multigrid Coupled Tsunami (COMCOT) model. In this study, the parameters being compared include wave height, wave propagation, and overtopping on the seawall under two scenarios : the run-up of solitary waves on a shore without a seawall and the overtopping condition with a seawall using the Solitary Wave generation type, following the experiments conducted by Huang et al en 2022. Several parameters in the laboratory case study should be considered to expand our understanding of the systematically discussed tsunami propagation and overtopping processes and evaluate the capabilities of the SPH and COMCOT models.

Perancangan Sistem Pendukung Monitoring Kinerja Program Studi Dengan Metode Balanced Scorecard Studi Kasus: Prodi Di Fakultas Teknik UKDC

The activity of implementing the performance evaluation of study programs in tertiary institutions aims to improve internal quality in a sustainable manner. The performance evaluation process requires a gradual process, namely the performance monitoring process. Evaluation and monitoring of study program performance are generally implemented in the implementation of education, research, and community service to improve study program performance. Therefore, the priority of the main performance indicators of study programs in the Faculty of Engineering is determined by referring to the Chancellor's Regulation No. 03/PR/2022, classifies the main performance indicators of the Faculty of Engineering study program based on the dimensions of the balanced scorecard, and designs a work program monitoring spreadsheet to support KPI achievement. The research also aims to identify KPIs in four stages: customer perspective, financial perspective, business process perspective, and learning and growth perspective. The University has prioritized the 1st, 2nd, 4th, 6th and 7th performance indicators. Regulation of the Dean of the Faculty of Engineering No. 143/UKDC.1/A.01/XI/2022 as a reference in setting KPIs, this document has succeeded in formulating 22 main performance indicators and 5 additional performance indicators. Prioritized performance indicators are then made into a spreadsheet-based performance form which is useful in implementing performance monitoring
  
 Keywords: Performance measurement, balanced scorecard, key performance indicators

범죄경력자용 사회적응예측지표 타당도검증

Historically, crime has occurred continuously, a risk factor promoting social anxiety worldwide. As it is impossible to solve the crime problem completely, the country has no choice but to manage crime prevention and countermeasures. Considering the social environment that avoids those with a criminal history, including pre-prisoners, severe punishments and social exclusion against them are expected to intensify. However, because we cannot wholly exclude or alienate them from our society, we must find a way to live harmoniously with them in our community. This study was conducted to verify the validity of the existing Korean Social re-Integration Predictive Indicator (K-SIPI) and improve its predictive power. In addition, we aimed to reduce the number of items with poor explanatory power on the life-emotional scale, which consisted of an excessive number of items that lessened the concentration of survey takers. To verify the validity, we conducted descriptive statistics, logistic regression analysis, ROC analysis, etc., by randomly collecting 2,514 cases from the K-SIPI data of the Korea Justice Protection and Welfare Service. In addition, the level of social adaptation of the subject of legal protection was divided into high, medium, and low through ANOVA. As a result of the analysis, 86 items in the current K-SIPI were reconstructed into 63 items through validation. Reconstructing the test tool's items concisely is meaningful in that it can increase the concentration of survey takers and ensure more reliable test results. For discussion and suggestions, it is necessary to conduct further research on the scales or items removed by validating the current K-SIPI. The measures or items emphasized in previous studies showed weak predictive powers in our study. We discuss this as a result of the current K-SIPI being conducted in the early stages of preparing for social return after release (i.e., before the Korea Rehabilitation Agency exercises rehabilitation). Furthermore, the K-SIPI is used only for pre-test rather than for post-test, making it impossible to measure the effectiveness and analyze the performance of various protective treatment programs provided to the target. Thus, making it mandatory to conduct pre-and post- K-SPI is needed for the program's performance evaluation.

Data-driven support for policy and decision-making in university research management: A case study from Germany

The management of universities requires data on teaching and research performance. While teaching quality can be measured via student performance and teacher evaluation programs, the connection between research output and its antecedents is much harder to check, test, and understand. To inform research governance and policy-making at universities, we clarify the relationship between grant money and research performance. We examine the interdependence structure between third-party expenses, publications, citations, and academic age. To describe the relationship between these factors, we analyze individual-level data from a sample of professorships and a Scopus database from 2001 to 2015. Using estimates from a panel vector autoregressive model with exogenous variables, impulse response functions, and forecast error variance decomposition, we show that decision-making based on university-level data is inappropriate and does not reflect the behavior of individual faculties. Our results quantify the difference between the quality and quantity of research output, a better understanding of which is important to design incentive schemes and promotion programs. The paper also proposes a visualization of the cooperation between faculties and research interdisciplinarity via the co-authorship structure among publications. We discuss the implications for policy and decision-making and make recommendations for university research management.

Consumer Baseline Estimation Analysis for Implementation of Demand Response Programs

ABSTRACT Demand response (DR) is the short-term change of consumers energy usage patterns in response to power utility needs. The utility benefits from DR adoption in terms of better load management, reduction of peak power deficits, energy deficits, enhanced reliability, and improved economic performance. Consumers gain from energy bill savings and incentive payments. Accurately estimating the consumer baseline load (CBL) is critical for evaluating the success of a DR program implementation. Estimation of CBL helps to decide the volume of load curtailment, decide the incentives to be offered, and assess the impacts of consumer participation. The real-time domestic 11 kV feeder data of the 6.3 MVA substation of Goa electricity board, Goa, India is used to analyze the performance of the DR program. For CBL analysis time series average, adjustment, exponential moving average, decomposition, and forecasting techniques are applied. For performance evaluation of DR programs, the Artificial neural network (ANN) based CBL estimation technique is utilized. The ANN-based technique of estimation has better prediction accuracy, lower bias, and reduced variability as compared to other CBL estimation techniques. Consumer response to demand changes is computed using elasticity and consumer benefit function. The ANN-based CBL estimation and demand variation obtained from elasticity values are further used to analyze the technical and financial performance factors, for dynamic price and incentive-based DR program implementation. The research can assist a state power utility that is implementing smart grids in categorizing consumers, establishing a baseline, identifying potential demand reductions, and evaluating the feasibility DR programs.

One-Year Mortality Is Not a Reliable Indicator of Lung Transplant Center Performance

BackgroundIn the United States, the Organ Procurement and Transplant Network (OPTN) uses 1-year mortality as the primary measure of transplant center quality. We sought to evaluate the reliability of mortality outcomes in lung transplantation and to compare statistical methods of program performance evaluation. MethodsWe used the Standard Transplant Analysis and Research files from the United Network for Organ Sharing to identify lung transplant recipients from 2013 to 2018 in the United States. We stratified hospitals on the basis of 30-day, 1-year, and 5-year survival by risk adjustment, reliability adjustment with empirical Bayes technique, and hierarchical bayesian mixed effects models currently used by the OPTN. We measured variation in mortality rates and identification of performance outliers between techniques. ResultsWe identified 12,769 recipients in 69 centers. Reliability adjustment reduced variation in hospital outcomes and had a large impact on hospital mortality rankings. For example, with 1-year mortality, 28% (5 hospitals) of the “best” hospitals (top 25%) and 18% (3 hospitals) of the “worst” hospitals (bottom 25%) were reclassified after reliability adjustment. The overall reliability of 1-year mortality was low at 0.42. Compared with the bayesian method used by the OPTN, reliability adjustment identified fewer outliers. The 5-year survival reached a higher reliability plateau with a lower volume of cases required. ConclusionsThe reliability of 1-year mortality in lung transplantation is low, whereas 5-year survival estimates may be more reliable at lower case volumes. Reliability adjustment yielded more conservative measures of center performance and fewer outliers compared with current bayesian methods.

Peningkatan Efektivitas Kinerja Guru Pendidikan Agama Islam melalui Manajemen Evaluasi di SMA Negeri 7 Muaro Jambi

This research aims to find out the evaluation of the performance of Islamic religious education teachers at Sma Negeri 7 Muaro Jambi. This research uses descriptive qualitative research methods. Data is collected by observation, interview, and documentation. The results showed that Sma Negeri 7 Muaro Jambi implemented the implementation of teacher performance evaluation program management held in each semester. The evaluation and monitoring activities are carried out directly by the principal and the Ministry of Religious Affairs. The evaluation program for the performance management of Islamic religious education teachers went quite well. Teachers always report their performance results shown through the learning outcomes of students who continue to experience improvement.

An evaluation of the isoniazid preventive therapy program performance for under-fives in Kwekwe City, January 2019 - December 2020: a descriptive cross-sectional study.

Childhood tuberculosis (TB) is underserved in resource-constrained endemic areas. Zimbabwe National Tuberculosis Program recommends tuberculosis prevention treatment for children aged <5 years who are close contacts of smear-positive TB cases. The Isoniazid Preventive Therapy (IPT) program performance had never been evaluated since its inception in 2010. We therefore, assessed the IPT program's inputs, processes, outputs, and outcomes. We conducted a process evaluation using the logic model in Kwekwe City. We recruited twenty-seven health care workers from all the five municipal health facilities. Smear-positive guardians of under 5 children, health care workers, and registers were the study population. Data were collected using a questionnaire and checklists and presented as frequencies and proportions. The IPT program met requirements in provision of guidelines (10/10), screening tools (15/15) and on-the-job trainings done in all five health facilities. Isoniazid tablets supply and quarterly budgeting did not meet meeting program requirements. Fifty-nine out of 231 (25.5%) children contacts of sputum-positive TB patients were screened. Fifty-one of the 59 (86.4%) children were initiated on IPT, 42/51 (82.4%) completed the course, one developed TB, 3/51 were still on treatment and 5/51 were lost to follow up. No dropouts and deaths were recorded. Unavailability of drugs was a barrier to the IPT and negatively impacts the TB elimination program. Contact screening was the bottleneck in the successful implementation of the program. Adequate staff and provision of drugs might improve the program. We recommended the recruitment of more healthcare workers and the budget for the program.

ICLAS LAQ Network for the Promotion of Animal Quality in Research.

ICLAS Laboratory Animal Quality Network (LAQN) programs currently consist of the Performance Evaluation Program (PEP), which focuses on microbial monitoring by and for laboratory animal diagnostic laboratories, and the Genetic Reference Monitoring Program (GENRef), which provides assay-ready reference DNA for genetic testing of mouse strains. Since 2008, PEP has grown to become a truly international program with participating laboratories in 5 continents. Launched in 2016, GENRef currently distributes DNA from 12 common inbred mouse strains for use in genetic monitoring of locally inbred colonies as well as for genetic testing of stocks, particularly genetically engineered stocks, of uncertain origins. GENRef has the capacity to include additional strains as well as additional species. PEP and GENRef provide the reagents at cost, as a resource to the international scientific community, in the interest of improving research quality in an environment of growing concern for research quality, rigor, and reproducibility.

Analysis of Seven Performance Evaluation Program Results for Pathogenic Bacteria from Laboratory Animals in 2013—2020

Analysis of Seven Performance Evaluation Program Results for Pathogenic Bacteria from Laboratory Animals in 2013—2020

Performance evaluations and junior auditors’ attitude to audit behavior: a gender and culture comparative study

PurposeThe purpose of this paper is to shed light on factors leading to unethical acts committed by auditors from a cultural and gender perspectives. It investigates differences in junior auditors’ attitudes towards audit behavior when a performance evaluation (PE) is anticipated. The objective of this study is to aid academicians and audit executives in developing new models of PE and internship programs that should mitigate dysfunctional behavior.Design/methodology/approachA survey adapted from Big Four companies’ performance appraisal templates was administered to junior accountants who have completed their internship programs and their external audit course at accredited universities in Lebanon and the USA. Several statistical tests were conducted to analyze the relationship between the different variables.FindingsThis paper shows how PE affects junior auditors’ attitudes to dysfunctional audit behavior (DAB). From a cultural standpoint, American auditors express more negative views towards DAB than their Lebanese counterparts. This paper also demonstrates that female auditors are less inclined towards DAB than male auditors.Originality/valuePrevious studies on the topic have been mostly conducted in developed countries with a scarcity of studies examining multiple countries. This study focuses on two different cultural contexts, a developed country, the USA and an emerging country, poorly represented in the literature, Lebanon. This paper also observes variances between male and female auditors in DAB when expecting a PE. The originality of this paper stems from its concurrent examination of the impact of gender and culture on DAB by using a sample of less-experienced auditors at the end of their educational path.

A Comparison of Current Methods for the Determination of Ra-226 and Ra-228 in Water by a Modified Georgia Tech Gamma Method Vs. US Environmental Protection Agency Drinking Water Methodologies.

Radium is a significant source of human radiation exposure both from natural sources (NORM, or Naturally Occurring Radioactive Material) and from technologically enhanced natural radioactive material (TENORM). Gamma analysis for 226Ra and 228Ra in water using high purity germanium (HPGe) detectors was compared with current methods from the US Environmental Protection Agency (EPA) using alpha scintillation and gas proportional counters. Extensive evaluations of a modified version of the original Georgia Tech HPGe method were performed. Known value 226Ra samples from the US Department of Energy (DOE) Mixed-Analyte Performance Evaluation Program (MAPEP) program, mixed 226Ra and 228Ra samples from the Environmental Resource Associates Quality Assurance Program (ERA), and mixed 226Ra and 228Ra samples from the Laboratory Proficiency Testing Program of the International Atomic Energy Agency (IAEA) were used for cross-check comparisons of the modified Georgia Tech method with other methodologies (EPA 903.1 and Ra-05 for 226Ra and 228Ra, respectively). Minimum counting times for our gamma instrumentation to reach a minimum detectable activity (MDA) of 0.04 Bq L-1 were also determined.

The Prevalence of Benign Pathology Following Major Pulmonary Resection for Suspected Malignancy

In the era of lung cancer screening with low-dose computed tomography, there is concern that high false-positive rates may lead to an increase in nontherapeutic lung resection. The aim of this study is to determine the current rate of major pulmonary resection for ultimately benign pathology. A single-institution, retrospective analysis of all patients > 18 y who underwent major pulmonary resection between 2013 and 2018 for suspected malignancy and had benign final pathology was performed. Of 394 major pulmonary resections performed for known or presumed malignancy, 10 (2.5%) were benign. Of these 10, the mean age was 61.1 y (SD 14.6). Most were current or former smokers (60%). Ninety percent underwent a fluorodeoxyglucose positron emission tomography scan. Median nodule size was 27 mm (IQR 21-35) and most were in the right middle lobe (50%). Preoperative biopsy was performed in four (40%) but were nondiagnostic. Video-assisted thoracoscopic lobectomy (70%) was the most common surgical approach. Final pathology revealed three (30%) infectious, three (30%) inflammatory, two (20%) fibrotic, and two (20%) benign neoplastic nodules. Two (20%) patients had perioperative complications, both of which were prolonged air leaks, one (10%) patient was readmitted within 30 d, and there was no mortality. A small percentage of patients (2.5% in our series) may undergo major pulmonary resection for unexpectedly benign pathology. Knowledge of this rate is useful to inform shared decision-making models between surgeons and patients and evaluation of thoracic surgery program performance.

Performance Evaluation of Humanities and Social Sciences Scholarship Programs in the Thai Higher Education System

Higher education in Thailand has undergone major changes due to digital disruptions, demographic transitions, and the immense competition which increases the need for continuous education, learning and human resources development. The purposes of this convergent parallel mixed methods study were as follows: (1) to monitor and evaluate humanities and social sciences in scholarship programs in the Thai higher education system; (2) to assess the outcome and the impact of the humanities and social sciences scholarship program; and (3) to provide feedback on how to increase the performance of the program. The quantitative design employed a set of surveys consisting of 114 items with a Cronbach's alpha reliability between .956-.996. The sample consisted of 208 faculty members across Thailand in the humanities and social sciences who received government scholarships. The qualitative data purposively conducted interviews with 27 participants from 12 different universities. The quantitative research showed that the factors related to the program outcomes and impact identified a significant relationship between the program Context, Input, Process, and Outcome and with high correlation coefficient (r) at .579, .522, .459 and .779, respectively. The qualitative research presented comprehensive recommendations to improve the performance of humanities and social science faculty members.